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This listing of claims will replace all prior versions and listings of claims in the 
instant application: 

LISTING OF CLAIMS 

1. (Original) An iterative method of equalizing an input signal received over a 
digital communication channel, said method comprising: 

(a) using a kernel density estimate where different values of a kernel size are 
indicative of either a blind or a decision-directed equalization mode; 

(b) processing a received signal using a blind equalization mode; 

(c) evaluating, on a block or sample basis, an error measure based on a distance 
among a distribution of an equalizer output and a constellation; 

(d) updating the kernel size based upon the error measure thereby facilitating 
automatic switching between the blind and decision-directed equalization modes, where 
the kernel size is initially set to a value indicative of the blind equalization mode; and 

(e) selectively applying blind equalization or decision-directed equalization to 
the input signal according to the updated kernel size for subsequent iterations of steps (c)- 
(e). 

2. (Original) The method of claim 1 , wherein the error measure is an estimate of a 
density distance. 

3. (Currently Amended) The method of claim 2, wherein the density 

at. ■ , , . a j- /r(*>-lltX( J '£> 
distance is calculated according to L 



{WP219919;!} 



2 



Appln. No. 10/814,448 

Reply to Ex Parte Quayle Action of November 17, 2004 
Docket No. 5853-407-1 

where f yr and f„ r are, respectively, an estimated equalizer output probability density and 

source constellation probability density; L is a window length corresponding to the 
number of recent output samples; N z is a number of points in a constellation; is a 

kernel function for kernel bandwidth cr 0 is a complex- valued equalizer output at time 

index k-i: s i is an i th symbol in the constellation; and where \\ denotes the p th power of the 

complex magnitude of its argument. 

4. (Original) The method of claim 3, wherein the error measure is a recursive 
forgetting estimate of the mean-square error. 

5. (Original) The method of claim 4, wherein the recursive forgetting estimate of 

P 

the mean-square error is denoted as * and is evaluated according to 

E M = aE k + (1 - a) min (y? -Sff 

1 '•**' ' , where a is a forgetting factor, y * is the equalized 

signal, and Si is derived from a constellation. 

6. (Original) The method of claim* 1, said step (a) further comprising initializing a 
learning rate, the error measure, a forgetting factor, and at least one constant for updating 
the kernel size. 

7. (Original) The method of claim 6, further comprising adjusting the learning 
rate. 
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8. (Original) The method of claim 1, wherein the kernel size is denoted as ° k and 

is calculated according to ° k ~ f( E k>&) ^ wherein / is a function with predetermined 

E 

constant parameter 6 and * is the error measure. 

9. (Original) The method of claim 8, wherein 6 is comprised of predetermined 
constant parameters a and b. 

10. (Original) The method of claim 1, wherein blind or decision-directed 
equalization is performed by multiplying the input signal with a vector of equalization 
coefficients. 

11. (Original) The method of claim 10, said step (e) further comprising updating 
the vector of equalization coefficients. 

12. (Original) The method of claim 11, wherein the vector of equalization 
coefficients is denoted as w * and is updated according to w * +1 = w * ± ^ V w^( w *) > where 
^( w *) i s the matched power density function or the sampled power density function 
criterion, Vw is the stochastic gradient, and is the learning rate. 

13. (Original) A system for performing an iterative method of equalizing an input 
signal received over a digital communication channel, said system comprising: 

(a) means for using a kernel density estimate where different values of a kernel 
size are indicative of either a blind or a decision-directed equalization mode; 

(b) means for processing a received signal using a blind equalization mode; 

(c) means for evaluating, on a block or sample basis, an error measure based 
on a distance among a distribution of an equalizer output and a constellation; 
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(d) means for updating the kernel size based upon the error measure thereby 
facilitating automatic switching between the blind and decision-directed equalization 
modes, where the kernel size is initially set to a value indicative of the blind equalization 
mode; and 

(e) means for selectively applying blind equalization or decision-directed 
equalization to the input signal according to the updated kernel size for subsequent 
operations of means (c)-(e). 

14. (Original) The system of claim 13, wherein the error measure is an estimate of 
a density distance. 

15. (Currently Amended) The system of claim 14, wherein the density 

j. . . . . t . ... />^>-lltX(- r /-> 

distance is calculated according to L 

/„<z)=72X.(Hn-,r)or N ' 2XH*J). 

L, i= Q iV J ,- =0 

where / and / are, respectively, an estimated equalizer output probability density and 

source constellation probability density: L is a window length corresponding to the 
number of recent output samples; N s is a number of points in a constellation; G c ^ is a 

kernel function for kernel bandwidth cr 0 i_ y k _ t is a complex-valued equalizer output at time 

index k-i\ s { is an i th symbol in the constellation; and where |-| denotes the p th power of the 

complex magnitude of its argument . 

16. (Original) The system of claim 15, wherein the error measure is a recursive 
forgetting estimate of the mean-square error. 
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17. (Original) The system of claim 16, wherein the recursive forgetting estimate of 
the mean-square error is denoted as * and is evaluated according to 



, where a is a forgetting factor, y * is the equalized 
signal, and s * is derived from a constellation. 

18. (Original) The system of claim 13, said means (a) further comprising means for 
initializing a learning rate, the error statistic, a forgetting factor, and at least one constant 
for updating the kernel size. 

19. (Original) The system of claim 18, further comprising means for adjusting the 
learning rate. 

20. (Original) The system of claim 13, wherein the kernel size is denoted as * and 
is calculated according to a * = f( E k>@) y wherein / is a function with predetermined 
constant parameter 6 and * is the error statistic. 

21. (Original) The system of claim 20, wherein 6 is comprised of predetermined 
constant parameters a and b. 

22. (Original) The system of claim 13, wherein blind or decision-directed 
equalization is performed by multiplying the input signal with a vector of equalization 
coefficients. 

23. (Original) The system of claim 22, said means (e) further comprising means for 
updating the vector of equalization coefficients. 
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24. (Original) The system of claim 23, wherein the vector of equalization 
coefficients is denoted as w * and is updated according to w * +1 " w * ± ^V( w J j where 
^( w *) is the matched power density function or the sampled power density function 
criterion, ^ w is the stochastic gradient, and ^ a is the learning rate. 

25. (Original) A machine-readable storage having stored thereon, a computer 
program having a plurality of code sections, said code sections executable by a machine 
for causing the machine to perform an iterative method of equalizing an input signal 
received over a digital communication channel, said method comprising the steps of: 

(a) using a kernel density estimate where different values of a kernel size are 
indicative of either a blind or a decision-directed equalization mode; 

(b) processing a received signal using a blind equalization mode; 

(c) evaluating, on a block or sample basis, an error measure based on a distance 
among a distribution of an equalizer output and a constellation; 

(d) updating the kernel size based upon the error measure thereby facilitating 
automatic switching between the blind and decision-directed equalization modes, where 
the kernel size is initially set to a value indicative of the blind equalization mode; and 

(e) selectively applying blind equalization or decision-directed equalization to 
the input signal according to the updated kernel size for subsequent iterations of steps (c)- 
(e). 

26. (Original) The machine-readable storage of claim 25, wherein the error 
measure is an estimate of a density distance. 



{WP219919;!} 



7 



Appln. No. 10/814,448 

Reply to Ex Parte Quayle Action of November 17, 2004 
Docket No. 5853-407-1 



27. (Currently Amended) The machine-readable storage of claim 26, 

wherein the density distance is calculated according to L 

f Y Az)=j^G ao (z-\y k J)or N > /„<r) = — £ G^z-^) x 

L i=0 s i=0 

where f and / are, respectively, an estimated equalizer output probability density and 

source constellation probability density; L is a window length corresponding to the 
number of recent output samples: N s is a number of points in a constellation: G ffQ is a 

kernel function for kernel bandwidth cr 0 i. is a complex-valued equalizer output at time 

index k-i: s. is an symbol in the constellation; and where |-| denotes the p th power of the 

complex magnitude of its argument . 



28. (Original) The machine-readable storage of claim 27, wherein the error 
measure is a recursive forgetting estimate of the mean-square error. 

29. (Original) The machine-readable storage of claim 28, wherein the recursive 

F 

forgetting estimate of the mean-square error is denoted as * and is evaluated according 

E k+l =aE k +(l-a) min (y?-S?J 
to i=i,.-.,tf, ^ where a is a forgetting factor, y * is the 

equalized signal, and Sf is derived from a constellation. 

30. (Original) The machine-readable storage of claim 25, said step (a) further 
comprising initializing a learning rate, the error statistic, a forgetting factor, and at least 
one constant for updating the kernel size. 
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31. (Original) The machine-readable storage of claim 30, further comprising 
adjusting the learning rate. 

32. (Original) The machine-readable storage of claim 25, wherein the kernel size is 
denoted as ° k and is calculated according to ° k = /^*»^), wherein /is a function with 
predetermined constant parameter 6 and * is the error measure. 

33. (Original) The machine readable storage of claim 32, wherein 6 is comprised of 
predetermined constant parameters a and b. 

34. (Original) The machine-readable storage of claim 25, wherein blind or 
decision-directed equalization is performed by multiplying the input signal with a vector 
of equalization coefficients. 

35. (Original) The machine-readable storage of claim 34, said step (e) further 
comprising updating the vector of equalization coefficients. 

36. (Original) The machine-readable storage of claim 35, wherein the vector of 
equalization coefficients is denoted as w * and is updated according to 

= ^ ± / i ,VK) ) where is the matched power density function or the 

sampled power density function criterion, Vyv is the stochastic gradient, and is the 
learning rate. 
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